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PROJECTION OF PIXELIZED COLOR IMAGES 

FIELD OF THE INVENTION 
[0001] This invention relates in general to video technology and, more 
particularly, to a display device having an interferometric modulator and a reflective 
light modulator. 

BACKGROUND OF THE INVENTION 
[0002] Various types of digital projectors are known in the art. One common type 
uses a combination of dichroic optics, three light modulator chips, and combining 
optics. The dichroic optics separate the light into primary color beams so that each 
beam may be modulated by one of the three light modulator chips. After 
modulation, the light beams are recombined before being displayed on a display 
surface. Providing three light modulator chips increases the size and cost of this 
type of projector. 

[0003] As an alternative, the use of LCD chips or panels can be somewhat cost 
effective. However, LCD panels require polarizing the light. Polarizing the light 
reduces output intensity while adding the cost of polarizing. 
[0004] Another type of projector utilizes a combination of sequential color 
generation, such as a white light source passing through a rotating color filter wheel, 
and a micro-mirror array. A significant portion of the potential color saturation is lost 
and visual artifacts such as color separation result from using sequential color. 
Designs such as scrolling color wheels can partially mitigate these issues but add 
complexity and difficult timing and assembly issues to the system. 

SUMMARY OF THE INVENTION 
[0005] According to principles of the present invention, in one embodiment, a 
projection system projects a pixelized color images onto a display surface. The 
projection system includes a light source, an interferometric modulator, and a 
reflective light modulator. The interferometric modulator is configured to modulate 
the wavelength of light and reflect modulated light toward the display surface. The 
reflective light modulator is disposed to receive light from the light source and 
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selectively reflect the light between the interferometric modulator and the display 
surface. 

DESCRIPTION OF THE DRAWINGS 
[0006] Figure 1 is a block diagram illustrating one embodiment of the present 
invention projection system. 

[0007] Figures 2-4 illustrate the operation of the reflective light modulator shown 
in Figure 1. 

[0008] Figure 5 is a flow chart illustrating one embodiment of the present 
invention method for projecting pixelized color images onto a display surface. 
[0009] Figure 6 is an exemplary operational timing diagram for generating a color 
according to one embodiment of the present invention. 

DETAILED DESCRIPTION OF THE INVENTION 
[0010] Figure 1 illustrates one embodiment of projection system 2 for projection 
of pixelized color images onto display surface 4. Projection system 2 includes light 
source 6, reflective light modulator or reflective based modulator array 8, color 
modulator or color modulator array 1 0, light trap 1 4, image processing unit 1 6, and 
viewing optics 18. In one embodiment, viewing optics 18 include projection optics 
12 and display surface 4. Figure 1 does not illustrate various optical components 
such as integrating rods, homogenizers, and relay optics that are particular to the 
specific projector system implementation with which the invention is used. 
[0011] In describing this invention, various terms are used to generally reflect 
complex concepts. For example, the term "color" when applied to a beam of light or 
pixel, or spot, of light refers to the particular spectral distribution of the beam or the 
pixel, which can have more than one meaning consistent with this disclosure. For 
example, the color red may refer to a highly monochromatic red beam of light or it 
may refer to a light having a spectral distribution having a spectral peak near red. 
[0012] Light source 6 is any source of light suitable for use in projection system 
2. One example of such a suitable light source 6 is an ultra high pressure mercury 
lamp. Additionally, one of the advantages of the present invention is a lower 
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etendue requirement from light source 6. Consequently, xenon and plasma bulbs 
are also examples of suitable light sources 6. 

[0013] Color modulator array 10 is any apparatus or system configured to 
modulate the wavelength of light and reflect modulated light toward display surface 
4. In one embodiment, color modulator 10 is configured to generate an intensity 
versus wavelength distribution that is peaked about a single wavelength. In another 
embodiment, color modulator 10 is configured to alter the spectral distribution of 
incoming light by absorbing most of the incoming light. 

[0014] In one embodiment, color modulator 10 is an interference based or 
interferometric modulator that modulates the spectral distribution of impinging light 
to generate an output color in response to an applied voltage signal. In this way, 
interferometric modulator 10 selects a color or spectral distribution that is 
transmitted to display surface 4. In the case of an interferometric modulator, color 
modulator 10 is also known as a Fabry Perot based light processing device. 
[0015] In one embodiment, color modulator array 10 is a device including an 
array of cells or color pixel elements. Each color pixel element has the capability of 
receiving white light and outputting light having a color spectral distribution that is 
peaked about a particular wavelength, such as red, green, blue, cyan, yellow, 
magenta, violet, or other colors depending upon the design of color modulator 10. 
[001 6] In one embodiment, each cell includes an optical cavity whose dimension 
normal to the array of cells is responsive to the application of a voltage across 
opposing plates that help to define the cavity. This can be done by controlling the 
voltage across the opposing plates or controlling charge injection to one or both of 
the opposing plates. 

[0017] White light impinges on each of the cells. As a result of optical 
interference, each cell reflects light having an intensity versus wavelength 
distribution that is peaked about a particular wavelength. Thus, the output of each 
cell is a voltage or charge selected peak wavelength. The light is then reflected 
from the cell to the viewing optics 18 and/or display surface 4. 
[0018] In an exemplary embodiment, each cell also has a black position (as a 
result of an input voltage or charge) wherein either very little or no light is reflected 
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from the cell. This can be referred to as the black condition for the light modulator 
element. 

[0019] Reflective light modulator 8 is any apparatus suitable for selectively 
reflecting light in projection system 2. Reflective light modulator 8 is disposed to 
receive light from light source 6 and selectively reflect the light toward color 
modulator 10 and display surface 4. Reflective light modulator 8 may have either 
the same resolution or a different resolution than color modulator 1 0. One example 
of a suitable reflective light modulator 8 is a digital micro-mirror device, also known 
as a digital mirror device, DMD, or a digital light processor DLP chip. 
[0020] In one embodiment, reflective light modulator 8 includes an array of 
reflective surfaces 20 (Figures 2-4) or mirror elements 20. Each mirror element 20 
is configured to define at least two possible paths for light through projection system 
2. In a first optical path, light passes from mirror element 20 to viewing optics 18 
while bypassing color modulator 10. In a second optical path, the light is modulated 
by color modulator 10 before passing to viewing optics 18. 
[0021] For ease of discussion, in this disclosure light is referred to as being 
"passed" from one component to another. Discussion of intervening optics such as 
relay optics, homogenizing or integrating optics, and polarizing optics, is omitted, as 
the details of these intervening optics are known in the art. 
[0022] Projection optics 12 receive modulated light from modulators 8 and 10 
and image that light onto display surface 4. In a presentation-style front projection 
system embodiment, projection optics 10 include "long throw" optics and display 
surface 4 include a projection screen or other surface that is physically separate 
from projection system 2. In an alternative embodiment for a rear projection 
television (RPTV), projection optics 10 include "short throw" optics and display 
surface 4 includes a screen that is integral to projection system 2. 
[0023] Light trap 14 is any apparatus or system configured to receive light 
reflected from reflective light modulator 8 and prevent it from being seen on display 
surface 4 or otherwise impacting proper operation of/or image formation by 
projection system 2. In an embodiment of the present invention with light trap 14, 
reflective light modulator 8 is further configured to selectively reflect light toward light 
trap 14. 
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[0024] Image processing unit 1 6 is any combination of hardware and executable 
code configured to receive video, image signals, or both, and generate proper 
control signals for modulators 8 and 1 0 in order to properly modulate the light beam 
from light source 6. Image processing unit 16 may include devices such as a 
coordinate conversion device for converting the incoming information to coordinates 
such as red, green, and blue (R, G, B) coordinates and devices to buffer the control 
information before it is passed to modulators 8 and 10. 

[0025] Figures 2-4 illustrate one exemplary embodiment of the operation of a 
single mirror element 20 or reflective pixel element 20. Other embodiments are also 
possible which are not illustrated, but are foreseeable by those skilled in the art. It is 
anticipated that reflective light modulator 8 would include an array of such mirror 
elements 20. The position and relative size and shape of items shown in Figures 2- 
4 is simplified to more clearly illustrate the present invention. For example, mirror 
elements 20 may include structures such as a separate yoke and hinge structure 
with an overlying reflective structure that results in a double layered mirror 
appearance. Discussion of this structural complexity is avoided because it does not 
illustrate the invention. 

[0026] In one embodiment, mirror element 20 includes an underlying substrate 
and associated addressing electronics. In an exemplary embodiment, the 
addressing electronics allows mirror element 20 to take on three positions - (1) a 
neutral, reset, or unlatched position wherein the surface of mirror element 20 is 
substantially parallel to a substrate surface that underlies the mirror element; (2) a 
first latched or deflected position wherein mirror element 20 is electrostatically and 
angularly deflected to a first side; or (3) a second latched or deflected position 
wherein the mirror element is angularly deflected to a second side that is opposite 
the first side. In alternative embodiments, the addressing electronics allow mirror 
element 20 to take on two positions or any number of desired positions. 
[0027] Depicted in Figure 2 is a single mirror element 20 in a first deflected 
position such that mirror element 20 passes light from light source 6 toward the 
viewing optics 18 without intervening color modulation. Avoiding color modulating 
reduces the absorptive loss of this light and generates less heat within color 
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modulator 10. Generating less heat within color modulator 10 reduces the cooling 
requirement for color modulator 10. 

[0028] Reducing the absorptive loss of the light allows more light to be passed to 
viewing optics 18. As a result of mirror element 20 being in the first deflected 
position, a bright white pixel element appears on the display surface 4. 
[0029] Furthermore, since this light avoids color light modulation, color modulator 
1 0 has less light to modulate. Providing less light for color modulator 1 0 to modulate 
consequently allows the number of bits of data processed by color modulator 10 to 
be reduced. Reducing the number of bits of data allows color modulator 1 0 to have 
a lower data rate requirement. 

[0030] Depicted in Figure 3 is the single mirror element 20 in the neutral position 
wherein mirror element 20 is substantially parallel to the underlying substrate. In 
this position, the light from the mirror element 20 is passed to one or more pixel 
elements of color modulator array 10. 

[0031 ] Depicted in Figure 4 is a single mirror element 20 in the second deflected 
position. In this position, light from mirror element 20 is passed to light trap 14. In 
an alternative embodiment for projector system 2, the second deflected position is 
utilized to pass light from light source 6 toward one or more pixel elements of color 
modulator array 10. In this alternative embodiment, the neutral position for the 
mirror array may be used to pass light to light trap 1 4. 

[0032] Referring again to Figures 1 -4, a light beam from light source 6 is divided 
into smaller beams of light by the reflective light modulator 8. Each of the smaller 
beams of light takes one of two optical paths before defining a pixel on display 
surface 4. In the case of a first optical path, the smaller beam passes from reflective 
light modulator 8 to display surface 4 without being color modulated by color 
modulator 10, thus producing a pixel on display surface 4 having a spectral 
distribution or color that is substantially the same as light source 6. In the case of a 
second optical path, the smaller beam passes from reflective light modulator 8 to 
color modulator 1 0 and then to display surface 4, forming a pixel on display surface 
4 having a color or spectral distribution pursuant to a control signal sent to color 
modulator 10. 
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[0033] The selection of the path taken by each smaller beam depends on the 
desired pixel color on display surface 4. If a pixel is desired to be white or 
substantially the color of light source 6, a light beam travels to reflective light 
modulator 8 where it is deflected along the first optical path to display surface 4, 
without color modulation from color modulator 1 0. The resultant color of the pixel is 
not modulated and hence and a substantially white pixel is displayed on display 
surface 4. 

[0034] If a pixel is desired to have a color different than light source 6, light 
travels to reflective light modulator 8 where it is deflected to color modulator 10. 
Color modulator 10 modulates the color or spectral distribution of the light and 
deflects the light to display surface 4. 

[0035] If a pixel is desired to be black, a light beam travels to reflective light 
modulator 8 where it is deflected to light trap 14. This prevents the light from 
reaching display surface 4, resulting in a black pixel. Black pixels can also be 
generated by deflecting them to color modulator 1 0 if the color modulator 1 0 has a 
black state. 

[0036] Figure 5 is a flow chart representing steps of one embodiment of the 
present invention. Although the steps represented in Figure 5 are presented in a 
specific order, the present invention encompasses variations in the order of steps. 
Furthermore, additional steps may be executed between the steps illustrated in 
Figure 5 without departing from the scope of the present invention. 
[0037] Light is generated 22. In one embodiment, light is generated 22 by light 
source 6. In an alternate embodiment, light is generated 22 elsewhere and piped 
into projection system 2. 

[0038] In one embodiment, a time is identified, for each pixel of the pixelized 
color image, that reflective light modulator 8 is positioned to reflect the light toward 
interferometric modulator 1 0 and toward display surface 4. 
[0039] In one embodiment, the generated light is selectively reflected, or passed, 
26 toward either interferometric modulator 10 or display surface 4. In an alternate 
embodiment, the generated light is selectively reflected 26 toward either 
interferometric modulator 10, display surface 4, or light trap 14. Interferometric 
modulator 10 modulates 28 the wavelength of light and reflects the modulated light 
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toward display surface 4. In one embodiment, the reflected light towards display 
surface 4 is focused 30 by projection optics 1 2 before passing to display surface 4. 
[0040] Referring again to Figure 1 , information is received at image processing 
unit 16 that defines an image, series of images, or a video sequence. Image 
processing unit 16 processes that information and then properly controls various 
components including modulators 8 and 1 0 in order to generate the image, series of 
images, or video sequence on display surface 4. 

[0041] The incoming signal may be one of a number of possible standards, 
including S-Video, a PAL signal (the European video standard), or an NTSC signal, 
the television standard in the United States for some time. There are a number of 
ways of implementing the control electronics for projection system 2, but what 
follows is one example. 

[0042] To simplify this discussion, light source 6 is treated as a sufficiently 
balanced white light source. If it is not, corrections can be made using color light 
modulator 10 by assigning a portion of the frame period for color correction. 
[0043] Image processing unit 6 includes a coordinate conversion device that 
converts information received into information that can be used by frame buffers of 
image processing unit 1 6. For example, the incoming information may be converted 
into red, green, and blue (RGB) values on a frame-by-frame basis. For each video 
frame, there is an array of RGB values for each pixel to be displayed on display 
surface 4. 

[0044] For each pixel location, the components of R, G, and B can be expressed 
as Nr, Ng, and Nb, respectively, wherein Nr is the red component to be displayed, 
Ng is the green component, and Nb is the blue component. Stated further, Nr, Ng, 
and Nb are normalized values that are proportional to the red, green, and blue 
component intensities for the pixel location during a particular frame period. 
[0045] In order to provide control signals for modulators 8 and 1 0, it is desireable 
to separate out a pure white signal that defines the first optical path that bypasses 
the color modulator as discussed above. This can be calculated as follows: 
[0046] Nw = "White Component" = Minimum value for Nr, Ng, and Nb. This 
value defines the time period for that pixel on frame period for which the first optical 
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path is employed. Stated another way, this defines a fraction of the frame for which 
white light is directed to the pixel location. 

[0047] During the remainder of the frame period, the non-white portion of the light 
can be generated using a second optical path. This contribution is computed from 
the coefficients with the white component subtracted out. 

[0048] Nr-Nw, Ng-Nw, and Nb-Nw = R, G, and B components, respectively, to be 
generated using color modulator 1 0. These components are hereafter referred to as 
the "residual" of the color components. 

[0049] Most actual white light sources are not perfectly balanced. For example, 
ultra high pressure mercury (UHP Hg) light sources tend to be somewhat deficient in 
red. References to a "substantially white" light source include light sources that are 
either spectrally balanced or have some deficiencies such as the UHP Hg light 
sources. Image processing unit 1 6 can include a correction factor "lookup table" to 
correct for an imperfectly balanced broad spectrum or substantially white light 
source. Alternatively, additional light sources such as red LEDs can be used to 
supplement the deficiencies of the light source. 

[0050] Illustrated in Figure 6 is an exemplary operational timing diagram for 
generating a color signal during a frame period T for a single pixel on image display 
surface 4. Modulators 8,10 are operated in cooperative manner for proper 
generation of pixels. 

[0051 ] As discussed above, the white component Nw is computed by the image- 
processing unit 1 6 as discussed above. This defines the "path 1 " or "P 1 " time slots, 
which refers to the portion of the time period for which the first optical path is used, 
as indicated in Figure 6. For maximum white intensity, such as a very bright star in 
a night sky, P1 may extend over nearly the entire frame period T. Note that to 
reduce visual artifacts and flicker, the time period for path 1 can be broken into 
multiple time slots across the frame period T as illustrated. 
[0052] Next, the remaining color coordinates are computed. These are 
generated using the second optical path indicated by "path 2" in Figure 6. Again, 
the signal is spread across the frame period to minimize flicker and/or visual 
artifacts. The remaining signal for this exemplary timing diagram, after subtracting 
white, is a combination of red and green is indicated in Figure 6. 
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[0053] The foregoing description is only illustrative of the invention. Various 
alternatives and modifications can be devised by those skilled in the art without 
departing from the invention. Accordingly, the present invention embraces all such 
alternatives, modifications, and variances that fall within the scope of the appended 
claims. 



